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Abstract 

In this paper, we study the high temperature or low connectivity 
phase of the Viana-Bray model. This is a diluted version of the well 
known Sherrington-Kirkpatrick mean field spin glass. In the whole 
replica symmetric region, we obtain a complete control of the sys- 
tem, proving annealing for the infinite volume free energy, and a cen- 
tral limit theorem for the suitably rescaled fluctuations of the multi- 
overlaps. Moreover, we show that free energy fluctuations, on the 
scale 1/N, converge in the infinite volume limit to a non-Gaussian 
random variable, whose variance diverges at the boundary of the 
replica-symmetric region. The connection with the fully connected 
Sherrington-Kirkpatrick model is discussed. 
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1 Introduction 



Diluted mean field spin glasses attract a great interest among physicists and 
probabilists, for at least two reasons. First of all, due to their finite degree 
of connectivity, they represent a sort of intermediate situation between fully 
connected models and realistic spin glasses with finite range interactions. 
Secondly, many random optimization problems arising in theoretical com- 
puter science are mapped in a natural way into the study of the ground state 
of diluted mean field spin glass models. The mean field character of these 
systems makes them exactly solvable, at least in the framework of Parisi 
theory of replica symmetry breaking pQ. Recently, many results have been 
obtained in this direction, culminating in the resolution of the K-sat model 
within the framework of "one-step replica symmetry breaking" in Much 
less is know from the rigorous point of view, two remarkable exceptions being 
Refs. jS] and [3]. In [3], through a suitable extension of the interpolation 
methods introduced in [S] and for fully connected models, S. Franz and 
M. Leone proved, for a wide class of diluted models, that the thermodynamic 
limit for the free energy density exists, and that it is bounded below by Parisi 
solution with replica symmetry breaking. In Ref. [3], instead, M. Talagrand 
proved that replica symmetry holds for sufficiently high temperature or low 
average connectivity. 

In the present work we concentrate on the case of the Viana-Bray model 
[Zj, jH], where each spin interacts through two body couplings of random 
sign with a finite random number of other spins, even in the infinite volume 
limit. This is a diluted version of the well known Sherrington-Kirkpatrick 
(SK) model jU] PP- We identify the replica symmetric region, and we obtain 
a complete control of the system there. In particular, through a suitable 
extension of the "quadratic replica coupling method" we introduced in JU] , 
we prove that annealing holds for the free energy, in the infinite volume limit. 
Moreover, as in [H], we prove limit theorems for the fluctuations of (multi)- 
overlaps and of the free energy. While the fluctuations of the multi-overlaps 
on the scale l/y/N turn out to be Gaussian in the infinite volume limit, like 
for the SK model, free energy fluctuations (on the scale 1/N) tend to a non- 
Gaussian random variable, whose variance diverges at the boundary of the 
replica symmetric region. 

The organization of the paper is as follows. In Section 2 we give the basic 
definitions concerning the model, and in Section 3 we discuss the role played 
by the multi-overlaps in its thermodynamical description. The relationship 
between the model under consideration and the fully connected one is con- 
sidered in Section 4. In Sections 5 and 6, we identify the replica symmetric 
region and we prove annealing for the free energy. Finally, in Sections 7 and 
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8 we prove limit theorems for the fluctuations in the annealed region, while 
Section 9 is dedicated to conclusions and outlook to future developments. 

2 Definition of the model 

The Hamiltonian of the Viana-Bray model [Zj, for a given configuration of 
the iV Ising spin variables <7j = ±1, i — 1, . . . , N, is defined as 

Here, £ a N is a Poisson random variable of mean value aN, for some a > 0, 
i.e., 

P(UN = k) = 7r(k,aN)=e- aNi -^- k = 0,1,2,..., (2) 

while {J^} is a family of independent identically distributed (i.i.d.) symmet- 
ric random variables, and i M , are i.i.d. integer valued random variables, 
uniformly distributed on the set {1,2,..., N}. We denote by J the depen- 
dence of the Hamiltonian on the whole set of quenched disordered variables 
(,aN, Jfj.,ifi, jii- The parameter a fixes the average degree of connectivity of 
the system. Indeed the number of different sites, which interact with a given 
spin variable, behaves approximately like a Poisson random variable of pa- 
rameter 2a, for large values of N. This is to be compared with the case of 
the SK model, where any spin interacts with all the other N — 1. A second 
important difference with respect to the SK model is that, in the present 
case, the infinite volume limit of the system does depend on the probability 
distribution p(J) of J M . In the case p(J) = 1/2(8(J - 1) + 8(J + 1)), the 
Viana-Bray model is closely related to the so called 2-XOR-SAT problem ^2] 
of computer science. In the course of this work, we do not specify the form 
of p(J), but for simplicity we assume J to be a bounded random variable 

\J\ < 1. (3) 

More general cases can be considered, at the expense of some additional 
technical work. 

The partition function Z N (f3, a; J), the disorder dependent free energy 
Jn(I3, a; J), the Gibbs state ojj and the quenched free energy — f3Ajsr{[3, a) 
are defined in the usual way, for a given value of the inverse temperature (3: 

Z N ((3,a;J) = J2^ HN{a,a '' J) (4) 
M 
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f N (/3, a; J) = -— In Z N (/3, a; J) (5) 

uj{0) = Z N ((3, a; J)~ l ]T 0{a)e^ H ^ a ^ (6) 

M 

A N ((3,a) = ±-ElnZ N (p,a;J) = —f3Ef N (f3, a; J). (7) 



Here, O is a generic function of the spin variables, and E denotes expectation 
with respect to all quenched random variables: 

E(-) = E iaN E w E M E {j M. (8) 

Like in the case of fully connected models, it is possible to prove that 
/jv(/9, a; 3) is self-averaging when the system size grows to infinity, and to 
give bounds, exponentially small in N, on the probability of its fluctuations. 
The precise result is stated and proved in Appendix A. 

As usual, one introduces real replicas as independent identical copies of 
the system, subject to the same disorder realization, and denotes with flj(.) 
the disorder dependent product Gibbs state 

Qj = J$ ® ujf o . . . , (9) 

where the state Uj' acts on the a-th replica. Moreover, the average (.), 
involving both thermal and disorder averages, is defined as 

(.) = EQj(.). (10) 

A very important role is played by the multi-overlaps between n config- 
urations , . . . , <j( n ' , defined as 

^4E«? , ...«f. (id 

i=l 

Of course, 

- 1 < qi...n < 1. (12) 

Notice that for n = 2 one recovers the usual definition of the overlap as 
normalized scalar product between two configurations. 

While for fully connected models the whole physical content of the theory 
is encoded in the probability distribution of the overlaps [T], all multi-overlaps 
play an essential role in the present case jjj, jH]. In Section 4 we will show 
how, when the limit of infinite connectivity is suitably performed, the multi- 
overlaps with n > 2 become inessential. 
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3 The role of the multi-overlaps 



An important ingredient of the methods employed in 3j is a smart use of the 
properties of the Poisson random variables. Indeed, while the choice of the 
Poisson distribution for the number £ a jv of terms appearing in the Hamil- 
tonian ([!} is in principle not essential (any other random variable sharply 
concentrated around the value aN would yield an equivalent model, in the 
infinite volume limit), it turns out to be a great technical simplification. The 
basic elementary properties one employs, for the distribution function of a 
Poisson random variable £a of parameter A > 0, are 

kir{k,\) = \n(k-l,\) (13) 

and 

^-7r(k, A) = -ir(k, A) + 7r(k - 1, A)(l - 5 k , ). (14) 

GfA 

In a sense, Eq. flT^j) replaces the identity 

EJF(J) = EF'(J), (15) 

which plays a fundamental role in the study of the fully connected models, 
and which holds for any smooth function F if J is a Gaussian standard 
random variable. 

For instance, let us show how Eq. ()13j) allows to express the internal 
energy of the Viana-Bray model as a sum of simple averages involving multi- 
overlaps. For an analogous computation, see Ref. j^j. One has 

f) ( H) 1 °° k 

^ k=l fi=l 

where (.) k denotes the average where the value of the random variable C, a N 
has been fixed to k. Then, using property (jI5J). 



(H) 1 

-jf = ~jjJ2 k7T ( k > aN ") ( J * a ik a ik) k = -at^ir(k-l,aN) (J k (T ik a jh ) k . 

k=l k=l 

(17) 



Now, we use the identity 



{ J k°i k Oj k )k = E uj( j k°i k °3 k )k = E — — — , (li 
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to rewrite (fTTj) as 



N a N* cujiexpipja^)) 1 j 



N 



a 



F j tanh(/?J) +^(^^0 
4^. l+tanhftfJW^W)' 1 J 



N 2 ^ 1 + tanh^J)^ (cTiCJj 

where J is independent of the couplings J M on which uj depends. Notice 
that we have employed the identity 

e PJ^ 3 = cos h(/5J) + a i(Tj sinh(/3J) (21) 

in the last step. Thanks to Q, | tanh(/3J)| < tanh/? < 1 so that the expres- 
sion in (|20J) can be expanded in absolutely convergent Taylor series around 
tanh(ySJ) = 0. Recalling the definition of the multi-overlaps and the symme- 
try of the random variable J, one finally finds 

-|^,a) = ® = -a£(Jtanh(/?J)) (22) 

oo 

+« X>i...2n+2> £ { Jtanh 2 " +1 (/3J)(1 - tanh 2 (/3J))} . 

n=0 

In the particular case where = ±1, the above expression reduces to 
--gpA N (J3,a) = -atanh/3 + a^(tanh/3) 2n+1 (l-tanh 2 /3)(g 2 . 2 „ +2 ). (23) 



n=0 



4 The infinite connectivity limit and the SK 
model 

In this section, we discuss the relationship between the Viana-Bray and the 
fully connected SK model. As it was already observed in [7j jH], the latter 
is obtained when the average connectivity a tends to infinity, provided that 
the strength of the couplings J M , or equivalently the inverse temperature, is 
suitably rescaled to zero. Let us discuss this point in greater detail. To this 
purpose, recall that the SK model in zero external field is defined by the 
Hamiltonian 

H s N K -{a;J) = -^= J2 <V^i> ( 24 ) 

l<i<j<N 
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where the couplings Jjj are i.i.d. centered Gaussian random variables of unit 
variance. Now, we want to compare the Viana-Bray model, with parameters 
(5 and a, with the SK model, at an inverse temperature f3' defined as 

(3' 2 = 2aEtanh 2 ((3J). (25) 

In particular we show that, in the limit a — > oo, (3 — > with f3' = const, one 
has 



lim ^-ElnZ^^a-J))^ l\\m ^E\n Z s N K -((3'; J)\ . 

N^oo iv J I N^oo iv J 



(26) 



To this purpose, let < t < 1 and define an auxiliary partition function 
Z^{t) as 



S,aNt 



z N(t) = ex p ( p Yl J ^ a u + p y -jf- JijWj ) ■ ( 27 ) 

{a} \ fJ,=l l<i<j<N J 

Of course, for t = 1 one recovers the partition function (jlj) of the diluted 
model, while for t = one has the partition function of the fully connected 
model, at inverse temperature j3'. The t derivative of 1/NE In Z^it) can be 
performed along the lines of the computation of dpA^^-, a) in the previous 
section, with the result 

~El*Z N {t) = a (e In cosh(/3J) - \ g E te ^ J ) { & J^ ( 28 ) 

~ (1 - (&)) (29) 

,,_ n /3 /2 \ a ^ £(tanh 2 "(/3J)) . 2 
a£lncosh(/3J) - — - - > — i i — -<gL.2n)- 



n 

n=2 

The term (J28j) derives from the t dependence of the Poisson random variable 
£,aNt m (EZj), while (J2T?|) comes from the \/l — t factor which multiplies the 
SK Hamiltonian. Before we proceed, let us notice that we have proved the 
inequality, uniform in N, 

j t ^E\nZ N (t)<aE\ncosh(/3J)-^, (30) 

whose implications will be discussed below. Now, it is easy to see that the t 
derivative we are considering vanishes for (3 — > 0, a — > oo, if the constraint 
(J25J) is satisfied. Indeed, for a — » oo Eq. (|23j) reduces to 

2a(3 2 EJ 2 = p' 2 + (I) , (31) 
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so that 

a£lncosh(/3J) - C = <*EM\ + - ^ + o(-\=o(-\ (32) 

4 2 4 \a J \a J 

and 

g^ Etanh 2n (/3J) / 2 a ^ /? 2n tt ^oo , . 

2 2^ n ^i-W - 2 n ~ > U ' ^ 

n=2 n=2 

which concludes the proof of (|26|1. □ 



5 The replica symmetric bound and the an- 
nealed region 

In jHj it was proven that the Parisi solution for the SK model, with an ar- 
bitrary number of levels of replica symmetry breaking, is a lower bound for 
the free energy, at any temperature. Along the same lines, this result was 
extended in [3| to the case of diluted models. In this context, one has to 
face the additional difficulty that, even at the level of the replica symmetric 
approximation, the Parisi order parameter is a function e 8j (the probability 
distribution of the effective field) rather than a single number, as it happens 
instead for fully connected models pQ. In the present section, we recall briefly 
the replica symmetric bound for the Viana-Bray model under consideration, 
and we discuss the high temperature or low connectivity phase, where this 
bound actually gives the correct limit. 

Let g be an arbitrary symmetric random variable (we assume its distri- 
bution to be regular enough to guarantee that all expressions below are well 
defined), and define the random variable u as 

tanh(/?u) = tanh(/5J) tanh(^). (34) 

Here, J is distributed like any of the couplings J M and is independent of them 
(as well as of g). For given (3 and a, the replica symmetric trial functional 
Frs(Pi a \ g) is defined as 

F RS (f3,a;g) = In 2 + aE In cosh(/3J) + E In cosh(/3 ^ u e ) - 2aE In cosh(/3u) 
~E In (l - tanh 2 (/?J) tanh 2 (,%i) tanh 2 (/?^ 2 )) . (35) 
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Here, ug are independent copies of u and gi, g 2 are independent copies of g. 
Then, one has [3j 

^E\nZ N ((3,a;J) < inf Fbs(P, oc;g) + O C^J , (36) 

where the infimum is taken over the space of symmetric random variables g. 
It is not difficult to see, computing the functional derivative of F R g({3,a; g) 
with respect to the probability distribution P(g) of g, that a sufficient con- 
dition of extremality for the replica symmetric functional is fSj 

g = ^2u e = - y^tanh-" 1 (tanh(/3J £ ) tanh(/3^)), (37) 
1=1 " i=1 

where the equality holds in distribution. It is clear that the above equation 
always admits the trivial solution g concentrated at the value zero, i.e., with 
P(g) = 5(g). In this case, 

F RS ((3, a; g = 0) = In 2 + aE In cosh((3J) (38) 

which corresponds to take the expectation with respect to the the random 
coupling signs before the logarithm, in the definition of An ({3, a): 

F RS (f3,a;0) = ^E\nE {signW} Z N ({3,a;J). (39) 

In the following, we call — 1/ (3F R s((3, a; 0) the "annealed free energy". The 
following result shows that, in a certain region of the parameters (3 and a, 
the trivial solution of ()37|) is actually the only one: 

Proposition 1. If 

2a E tanh 2 (f3 J) < 1 (annealed region), (40) 

the only symmetric random variable g satisfying equation is the degen- 
erate one: P(g) = 5(g). 

Notice that, for a < 1/2, the annealed region extends up to (3 = oo. 
Proof of Proposition Q Let 

<f)(v)=Ee iv9 (41) 

be the characteristic function of g, which can be rewritten, thanks to condi- 
tion (JBTj). as 

In 0(t») = 2a yE exp tanh _1 (tanh(^J) tanh(/%))^ - 1^ • (42) 
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This implies that 



\\n(f)(v)\ <2a\v\^2aEtanh 2 ((3J), (43) 
where we used the fact that 

Eg 2 < 2a, 

as it easily follows from ()37)) and from \J\ < 1. Now, one can iterate the 
procedure, replacing the random variable g which appears at the right hand 
side of (I42|) with the expression given by Eq. ()37)) . and so on. At the n-th 
step of the iteration one has the bound 

\ln(j)(v)\ < 2a\v\ (2aEtanh 2 (ftJ)) n/2 . (44) 

which goes to zero when n — > oo, if condition (|4()jl holds. □ 
On the other hand it is easy to realize that, outside the annealed region, 
the choice of the identically vanishing g does not realize the infimum in (|36|. 
Indeed, consider even the simple case of a two- valued random variable g with 
distribution 

P(g) = ~(6(g-g ) + 6(g + g )). 
When g ~ 0, one finds 

F RS (ft, a; g) - F RS (ft, a; g = 0) = -/3\ 4 (1 - 2a£ tanh 2 (/3J)) + O(^ 6 ), (45) 

which is negative if (|4T)|) does not hold. 

It is interesting to observe that breaking of annealing outside the region 
(|40|) can also be proved through a comparison with the SK model. Indeed, 
integration of the inequality (|30*j) with respect to t between and 1 gives 

1 3' 2 1 

ln2 + a£lncosh(/3J) - —E\nZ N (/3, a; J) > In 2 + - — E In Z S N K \(3'] J), 

i.e., the difference between the quenched and the annealed free energies is 
larger (in absolute value) for the diluted model than for its fully connected 
counterpart if ft, a and ft' are related by the condition (j2EJ). Therefore, since 
it is well known that 

lim —E In Zfi K - (ft'; J) < In 2 + tL. (46) 

N^oo N 4 

for ft' > 1, one has immediately breakdown of annealing for the Viana-Bray 
model, when ft' 2 = 2aEtanh 2 (ftJ) > 1. 
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6 Control of the annealed region 

In the present section we prove that annealing actually holds for the Viana- 
Bray model in the region of parameters (|4"0*|) . i.e., that 

Theorem 1. For 2aEtanh 2 (/3J) < 1, 



We prove the theorem via a suitable adaptation of the "quadratic replica 
coupling" method we introduced in JU] for the SK model. While the above 
result can also be obtained through the "second moment method" (THj, which 
consists in showing that 



the quadratic method we employ allows us to obtain self-averaging of the 
multi-overlaps in a stronger form, and to prove limit theorems for the fluc- 
tuations, as shown in the next two sections. 

Consider a system of two coupled replicas of the model, defined by the 
partition function 



Zg\{3,a,\;j)= e-^ 1 ^-^ 2 ^^^' (49) 



where A > 0. Notice that the quadratic interaction gives a large weight to 
the pairs of configurations whose overlap is different from zero. Like in ^0] 
the idea is to show that, if A is not too large, the interaction does not modify 
the infinite volume free energy density, so that gi 2 must be typically close to 
zero. Indeed, we can prove 

Theorem 2. In the region 







(A + 2a£tanh 2 (/3J)) < 1, A, a > 0, 



(50) 



one has 





and 




(52) 
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Of course, this result implies the previous Theorem 2 since, for A = 0, 
In zf (/?, a, 0; J) = In Z N tf, a; J). 
Proof of Theorem^ First of all, since jH] 

Ai^lnZ^.a; J) = £lncosh(/3J) - ~ f) <g? 2 J, (53 ) 

71=1 

and 

(^...2n) = ^ E M>^') < E Mfa'i) = (54) 



i,j=l i,j=l 



one can write 



A ^ S (A«;0) - ^lnZ^ < ^SlnCl-tanh'CSJ))- 1 . 

(2) 

Therefore, using convexity of \nZ N with respect to A and the identity 

1 



(55) 



d\ 2N 
one has 



° 1 ElnZg\[3,a,\;J) 



F RS (f3,a;0) — I < 



= t\«&>, (56) 

A=0 4 



9 / . ElnZ N \ 2£ln(l - tanh 2 ^))" 1 I E\rZ%\\) ElnZ 



N 



da V N J ~ A V 2iV AT 

Next, we need an upper bound for 1/{2N)E In Z%> . To this purpose, we take 
A to depend on a as A (a) = Ao — 2a.Etanh (PJ), and we compute 

f/ 1 £ln4 2) (A«^(«);J) = -lEtanh 2 ((3J)(q 2 12 ) aMa) + £lncosh(/3J) (58) 



da2JV " v'"'"^""' 2 

V 



^ J> ln [(1 + tanh 2 (/?J)fi QiA(a) ( ( x l V) ( T 2 ( T 2 )) 2 -4tanh 2 (/5J)^ jA(a) ( ( x,a J )] 



4AT2 

where we employed Eq. (jUj) and the symmetry of J. Here, the averages 
refer to the coupled system with parameters a, X(a). Then, 

^^ElnZg\p,a,\(a)-,J) < -^tanh 2 (/?J)(g 2 2 ) a , A(a) (59) 

+E In cosh (/3 J) + - ln(l + £ tanh 2 (/3 J) (g 2 2 )) 
< £lncosh(/3J), (60) 
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where we used Jensen's inequality to take expectation inside the logarithm, 
and the elementary estimate 

ln(l + x) < x. 
Therefore, integrating between and a one has 

^E\nZ%\(3,a,\;J) < a£lncosh(/3J) + -L In £ e^^/ 2 {61) 

since at a = only the quadratic replica coupling survives in the Hamilto- 
nian. At this point, the proof proceeds exactly like in [10J: one introduces an 
auxiliary Gaussian standard random variable z with probability distribution 

dfi(z) = e- z2 / 2 </; 



/2tt 

and performs a simple rescaling, to write 



^ln e NXoq2l2/2 = ^ In f e^^^d^z) (62) 

= In 2 + ^ In y yZexpJV^ + lncosh^V^)^. (63) 



For A = A + 2a£tanh 2 (/3J) < 1, one can employ the inequality 

2 In cosh x < x 2 (64) 
to deduce, from Eqs. (JBTj) and (J53)l . 

^£ In 4 2) 09, a, A; J) < 1 In (p,a;J) + ± In — L-, (65) 

so that Eq. (jSTj) reduces to 

d („ ,„ , E\nZ N \ 2Eln(l -tanh 2 ^))- 1 / ,„ . E 
— (F RS (f3,a;0) < ^ "LJL- I Frs ^ a . ) _ 



+0(N- 1 ) 



As in [TO], this implies 



771 1 ry 

F RS ((3 } a;0) —J* J = C^JV" 1 ), for 2a£tanh 2 (/?J) < 1, (66) 
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since 



= 0. 

a=0 



Statement (|51j) then follows if one notices that, thanks to ([65)1 . (JSfiJl and to 
monotonicity of the free energy with respect to A, 

F RS (P,a;0)+O(N- 1 ) = ^E\nZ N < ^E\nZ%\\) < F RS (P,a ] 0)+O(N- 1 ) 

(67) 

in the region (jfiOjl . Finally, statement (|52jl follows from (|51jl and from con- 
vexity of .ETnZjy- with respect to A. □ 



7 Multi-overlap fluctuations in the annealed 
region 

In the previous section, we proved that the multi-overlap among any 2n 
configurations a^ ai \ . . . , a^ a2n ^ is typically small, in the annealed region. To 
study the infinite volume behavior of the multi-overlap fluctuations, we define 

1 N 

= VNg ai ... a2n = ^ • • • ^ 

v i=i 

(Due to symmetry under permutation of the indices Oj, we will always assume 
them to be ordered as a x < a 2 < . . . < a 2n .) Then, like for the SK model 
at high temperature [Hj, [TT], [T3], one can prove that the rescaled (multi)- 
overlaps behave like independent centered Gaussian variables, in the infinite 
volume limit. Indeed, we prove the following 

Theorem 3. In the annealed region MOj) , the variables 7] a ^'" a2n converge in 
distribution, as N — > oo, to a centered Gaussian process r] ai - a2n with covari- 
ances 

«""' ° 2 - )2> = i-2 aE L^j) (68) 

( v ^- a ^ v bl - b2n ) = if 3 i : en ^ bi (69) 

(rf 1 ~ a »»n ai ™ aa »') = if n^n'. (70) 

Remark Notice that, when the boundary of the annealed region (j4T)j) is 
approached, only the variance of r] aia2 diverges. 
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Proof of Theorem^ For simplicity, here we prove only that 

<f) N (u) = / e iu < 2 ) — > exp f — j- — -1 . (71) 

r KJ \ I y \ 2(1 -2a£tanh 2 (/3J)V V ! 

The generalization (|fi8|) to n > 1 and the proof of the independence (|69)1- 
()70|) of the limit random variables, though technically heavier, present no 
additional conceptual difficulty 

The proof is based on the cavity method [l] (see [IE], [Hj and, in par- 
ticular, which in essence consists in analyzing what happens when one 
removes one of the spins, thereby transforming the original system into one of 
size N — 1. As in JT] , the idea is to write down a linear differential equation 
for <f>jf{u), in the thermodynamic limit. First of all, using symmetry among 
sites one can write 

d u <j> N {u) = i (v^e iu ^) = i^N (trlrofc*^) . (72) 
Notice that, thanks to Theorem El of the previous section, 

\d u Mu)\<((VN) 2 ) l *<C, (73) 
uniformly in N. Then, defining 

u = Uy/l - l/N, 

one has 

9 u (Pn(u) = i\/N (^alfcr^exp {iua^a^ / y/N + iu (74) 
= -u(t> N {u) + iy/N fe(7^ 2 -^ + (l) (75) 

where the term o(l), vanishing for N — > 00, arises from the expansion of 
exp(iucrlfO-% / yN) around u = and from the replacement v! u. Now 
consider the set 

A={J:$i*:i li =j li = N}, (76) 

where i^j^ are the random site indices appearing in (JTJ). Since the proba- 
bility of A is very close to one, 

P{A) = 1-0(1/N), 

one can write 

iVN (ctWn^- 1 ) = i^N ^e^-U^ + o(l) (77) 

15 



where 1,4 is the indicator function of the set A. Next, we single out all terms 
— Jv a i v QN m the Hamiltonian (0) involving the N-th spin (the number of 
these terms is a Poisson variable of mean value 2a) and we rewrite |J77|) 

as 

^(e^'^-^^^exp^E^^Ef^i^l)) r- A 
iy/NE — ^ ? r L = iVNE-, (78) 

tV [Av exp(/3 E,=i, 2 0% Eti J AS) B 

where Av denotes average on the two- valued unbiased variables a e N = ±1 and 
fi'(.) is the Gibbs average for a system with N — 1 spins and connectivity 
parameter a' = a(l — 1/(N — l)) 1 . Of course, since we are restricting to 
the set A, the indices i u are i.i.d. random variables uniformly distributed 
on {1, . . . , N — 1}. Now, we show that the denominator B in ()78)1 can be 
replaced by the random variable 

B = H cosh 2 {fl J u ), (79) 
i/=i 

by neglecting an error term which vanishes in the thermodynamic limit. To 
this purpose we use the obvious identity 

A A AB A ( B - b\ 2 

E— = 2E— — E— h E— — = — , 80 

B B B 2 B y B J K J 

as it was done in [17J. As we will show below, the last term in the r.h.s. 
vanishes for iV — > 00. The first term is easily computed. Indeed, recalling 
the mutual independence of the variables J u ,i u and using the formula 

Ea^ = e~ x{1 - a \ 

which holds for a 7^ if £\ is a Poisson random variable of mean A, one finds 

iVNE^ = iVNE tt' je'"'""-! sinh ^2aEtanh 2 (/3J) J*' 1 j . 

Then, expanding the sinh(. . .) at first order around zero and recalling that 

sup((^ 2 ) 2 ) < 00, 

N 



lr This is because the average number of terms appearing in the modified Hamiltonian 
of the N — 1 spin system is Na — 2a = a'(N — 1) 
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one has 

i^NE^r = 2iaE t&nh 2 ((3 J)E VI' le^-^^A + o(l) 
B "~ J 

= 2a£tanh 2 ( ( 5J)<9 u JV (w) + o(l). 
As for the second term in (|8()jl. one finds again 
AB 

iVNE^- = 2aEt&nh 2 (pj)d u (j) N {u) + o(l). 
i? 2 



(82) 



Finally, we show that the last term can be neglected. First of all, one has 

B > 1, 

as it follows from Jensen inequality, interchanging the thermal average fl' 
and the exponential in the definition of B. Therefore, 



E 



A B-B 



B 



B 



< VNEe 2 ^ 2a | 1 



B 
B 



(83) 



The computation of (JHHj) proceeds in analogy with that of EA/B. In this 
case, however, one finds that the dominant term in the Taylor expansion is 
of order 



1 



Therefore, recalling Eqs. (jSDJ), (JSH), (JH2J), together with Eq. fT^jl . we find 
that <Pn{u) solves the linear differential equation 

(1 - 2aEt&nh 2 (pJ)) d u <p N (u) = -u<p N (u) + o(l) (85) 

which, together with the obvious initial condition 

<M0) = 1, (86) 

implies the result (f7Tj) . □ 



8 Free energy fluctuations 

Is easy to realize that the Viana-Bray model resembles locally a spin glass 
model on a tree, where the number of branches starting at each node is a 
Poisson random variable of parameter 2a and the couplings associated to the 
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branches are i.i.d. random variables J M . The non-triviality of the Viana-Bray 
model arises from the presence of loops of length O(lniV) in the underlying 
graph. For the model on the tree, the computation of the partition function 
for any disorder realization is elementary, 

Z% ee (P, a; J)=2 N H cosh^), (87) 



so that 



^E\nZ% ee (p,a;J) = In 2 + a£lncosh(/3J). 



Theorem^shows that, in the annealed region, the Viana-Bray model behaves 
like its tree-like counterpart, as far as only the infinite volume limit of the 
free energy density is concerned. However, the difference between the two 
models becomes evident if one looks at the difference between the respective 
free energies, on the scale 1/N. Indeed, the following result holds: 

Theorem 4. Define the random variable 

f N (P,a;J) = \nZ N (P,a-J) - (N\n2 + J2^cosh([3Jj), (89) 

where Ji, . . . , J^ aN are the same couplings which appear in the Hamiltonian 
(OJ). In the annealed region fijffl /jv(/3, a; jT) converges in distribution, as 
N — > oo ; to a non-Gaussian random variable f with characteristic function 

EeMisf) = exp < -- > ' ifl (« - 1) . . . (is - (2n - l))^lr ^^(^ 




(2n)! 

The variance of the limit random variable diverges when the boundary of the 
annealed region is approached. 

Remark It is not difficult to check that, when the infinite connectiv- 
ity limit is performed as in Section 4, the limit random variable becomes 
Gaussian (the terms of order higher than s 2 disappear in the series) and one 
recovers the well known result of Ref. ^Hj for the fluctuations of the SK free 
energy at zero external field and f3' < 1. 

Proof of Theorem ^| The idea of the proof is to write down a linear 
differential equation for the characteristic function 



[a,s) = E exp(isf N ). (91) 
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Of course, for a = both the Viana-Bray and the tree model consist in an 
empty graph, so that 

<MM = 1- (92) 

As for the a derivative, the computation can be performed along the lines of 
the computation of dpA^^.a) in Section 3, with the result 

9 ^ ,S) = -NM<*, s ) + E EelSf ' N t 1 + tanh^J)^^^))^ . (93) 

Since |tanh(/3J)| < tanh/3 < 1, one can expand the r.h.s. in an absolutely 
convergent Taylor series, using the formula 



;i+*r = i+X; 



a(a-l)...(a-(n-l)) ^ n 

Jb 



ni 

n=l 



and write 



da ^ ^ ' (2n) 

n=l v ' 

Notice that, thanks to Theorem 

(Nqt. 2n ) < (Nq 2 12 ) < sup(Nq 2 12 ) < oo 



N 



and the derivative in (|9~3j) can be bounded uniformly in N. Next, we can 
replace Vtj{Nq\ 2n ) with {Nq 2 2n ). Indeed, thanks to Theorem 01 of the 
previous section, 

(^ANqt. 2n ) - {Nqt_ 2n )f) = ((v^f (v% +1 " An ?) ~ ((V^T) 2 = o(l).(95) 
Therefore, denoting by (f) the infinite volume limit of <pNi one has 

d<j>(a,s) ^is(is-l)...(is-(2n-l)) Etanh 2n ([3J) ,. , . . 
~toT = g W! l-2^tanh-(^) 0(a ' S) ' (96) 

from which the statement of the theorem follows after integration with re- 
spect to a. □ 
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9 Outlook and conclusions 

In this paper, we have provided a complete picture of the high temperature 
or low connectivity phase of the Viana-Bray model, where annealing holds. 
Breaking of annealing is forecasted by the divergence of fluctuations of the 
free energy density (on the scale 1/N) and of the two-replica overlap (on 
the scale 1/yN). On the other hand, the fluctuations of the multi-overlap 
among 2n > 4 configurations show no singularity when the boundary of the 
annealed region is approached. 

The high temperature phase of the diluted p-spin model with p > 2 can 
be studied with the same techniques, but in this case one does not control 
the whole expected annealed region. On the other hand, the methods we 
presented here do not extend directly to the study of the replica symmetric 
region of the K-sat model, or of the diluted mean field model in presence of 
a magnetic field. In this case annealing does not hold, even at high temper- 
ature, and the random variable g which realizes the infimum of the replica 
symmetric functional is not trivial, as it is well known (see for instance [T9*]). 
We plan to report on this subject in a future paper. 

Appendix 

A Self-averaging of free energy and ground 
state energy densities 

In this section we prove an upper bound, exponentially small in N and in- 
dependent of j3, for the fluctuations of the disorder dependent free energy 
density of the Viana-Bray model. Independence of j3 implies that the bound 
holds also for the fluctuations of the ground state energy density. Similar 
results have been known for a long time in the case of fully connected mean 
field spin glass models (for instance, see ^3] and references therein) and for 
some random optimization problems [21]], [2Tj . 

Theorem 5. For any value of (3, a and N, one has 



Remarks The theorem can be immediately extended to the more general 
class of diluted spin glass models considered in In particular, for the 
diluted p-spin model |22] with p > 3 the above result holds without any 




(97) 
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modification, while for the K-sat model one has to replace ()97|) by 



P I - ^~Tt7T~~ <-u)< e N ( u ~^ ta < 1+ *» u > (98) 
\ Np N/3 ~ J ~ 

flnZ N E\\iZ N \ N(-u- a (i-^)in(i-^)) n ^ . / nrA 

P — — — — — > u < e v ex a * ) < u < a (99) 

\ ~ ) ~ 

( In Z?v £7 In Z/v \ 
P — f —^>u)=0 u>a. (100) 



(The latter is a simple consequence of the fact that, for the K-sat, 1/N In Zn < 
In 2 for any disorder realization, and that 1/NEIu.Zn > In 2 — a/3, as it is 
easily verified from the definition of the model.) In particular, Eqs. ([98 )1 - ([99 )1 
allow to recover the bound given in j2H| for the fluctuations of the minimal 
fraction of unsatisfied clauses in the K-sat problem. 

Proof of Theorem^ We sketch just the main steps in the proof, since it 
is very similar in spirit to that given for fully connected models in [I3j P^l - 
the main difference being that the role of Gaussian integration by parts is 
replaced here by the properties ()13j) . ()14|) of Poisson random variables. 

Introduce the interpolating parameter < t < 1 and define, for s £ R, 

<p N {t) = lnE 1 exp{sE 2 lnZ N (t)} , (101) 

where 

(SLat* ^Ljv(i-t) \ 

zZ J >^h+ E ( 102 ) 
n=i v=X J 

Here, all variables with upper index 1 are independent from those with index 
2, and E e denotes the average 

E t (.) = E^jtyE^yEytyi.), £=1,2. 

The motivation for the introduction of </?jv(^) is the identity 

exp{v?Ar(l) - <p N (0)} = E exp{s (\nZ N - E\nZ N )} . (103) 

Since we want to bound the r.h.s. of (|103|) . we compute the t derivative of 
ifiN(t). After some straightforward computations, one finds 

V JV El [ e sE 2 \nZ N {t) Ej ( e sE 2 hx U {e^^) _ y _ s E 2 \nu(e PJrT ^))) 
m' (t) = n ^ j=1 I ^ LL 

* NK) N E 1 exp{sE 2 lnZ N (t)} 
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and, thanks to the trivial bounds 

-P < E 2 \nuj(e f3Ja ^) < (3 

one has 

\<f/ N (t)\<aN(eW-l-\s\P). (104) 

Putting together Eqs. (jl04j) and (jl03j) . employing Tchebyshev's inequality 
and optimizing on s, one finally finds the statement of the theorem. □ 
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